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(54) Reproduced image transmitting apparatus 



(57) A reproduced image transmission apparatus 
which can display reversely reproduced images normal- 
ly even when the transfer order of asynchronous trans- 
fer and isochronous transfer is not ensured on 
IEEE1394, in cases where an apparatus for generating 
the reversely reproduced images and an apparatus for 
decoding the reversely reproducing images are con- 
nected with each other via an IEEE1394 network. An 



MPEG transport stream processing means 15 embeds 
control signal for controlling decoding in an MPEG pic- 
ture, and transmits the signal together with the MPEG 
picture through the IEEE1394 network in the iso- 
chronous transfer mode, whereby the synchronization 
between the MPEG picture and its control signal is sure- 
ly obtained, thereby to generate reversely reproduced 
images according to MPEG using P and B pictures. 
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Description 

FIELD OF THE INVENTION 

[0001] The present invention relates to an image re- 
production system that transmits MPEG images which 
are stored in a hard disk included in a transmission ap- 
paratus, to a receiving apparatus via a bidirectional net- 
work according to IEEE1394 or the like. More particu- 
larly, this invention relates to a reproduced image trans- 
mitting system in which reversely reproduced images 
are generated with employing P or B pictures in the re- 
ceiving apparatus. 

BACKGROUND OF THE INVENTION 

[0002] in recent years, as speeds of networks have 
increased and capacities of hard disks have been ex- 
panded, a system has come out which stores digital im- 
ages recorded according to MPEG or the like, in a hard 
disk, and transmits the stored digital images to a receiv- 
er via a network. This video network system employs a 
high-speed network based on IEEE1394. A storage de- 
vice including a hard disk is connected via this network 
with a reproduction apparatus which receives data to re- 
produce video images. 

[0003] 1EEE1394 has an isochronous transfer func- 
tion that ensures the amount of data which are trans- 
ferred during a prescribed time period. Because the is- 
ochronous transfer ensures the amount of data trans- 
ferred during the prescribed time period, this is suitable 
I o r transmission of video or audio which requires a real 
time property, and mounted on a large number of STBs 
of BS digital broadcast in Japan or digital VCR appara- 
tuses 

[0004] IEEE1 394 further has an asynchronous trans- 
fe r function for transferring data or commands. This 
asynchronous transfer is of a mode in which the right to 
use a bus is obtained to transmit data when desiring to 
transmit data, whereby the amount of data transferred 
during a prescribed time period is not ensured. 
[0005] At present, detailed commands are defined in 
IEEE1394 by DVB (Digital Video Broadcasting Project), 
IEEE1 394 T.A. (Trade Association), and the like. Partic- 
ularly according to IEEE1394 T.A., formats of MPEG 
transport streams to be transmitted on an IEEE1394 
network, commands for controlling digital VCRs by us- 
ing disk storages, and the like are determined. These 
commands a re transferred in the asynchronous transfer 
mode. 

[0006] However, according to IEEE1394, even when 
packets are outputted in the order of the asynchronous 
transfer and the isochronous transfer, there is no guar- 
antee that the packets are transmitted on the network 
in the order of the asynchronous transfer and the iso- 
chronous transfer. Mo re specifically, even when packets 
are outputted in the order of the asynchronous transfer 
and the isochronous transfer to a packet transmitting ap- 



paratus according to IEEE1394, the packets are some- 
times transmitted in the order of the isochronous trans- 
fer and the asynchronous transfer on the IE EE1 394 net- 
work. 

5 [0007] On the other hand, when reversely reproduced 
images are generated with MPEG pictures by using B 
pictures (bidirectionally predictive coded pictures) or P 
pictures (inter-frame forward predictive coded pictures), 
display of the decoded images should be switched for 

10 each picture. 

[0008] Figure 3 illustrates a structure of an MPEG de- 
coder using B pictures and P pictures. An MPEG image 
input 3a to be decoded is inputted to an MPEG decoder 

31 which performs decoding that is compliant with syn- 
is taxes according to MPEG. A reference picture memory 

32 is a memory that stores reference pictures which are 
necessary to decode MPEG images. In this case, refer- 
ence pictures at the decoding of MPEG images are 
stored in the reference picture memory 32. The MPEG 
images decoded by the MPEG decoder31 are stored in 
a frame memory 33, and the images in the frame mem- 
ory 33 are displayed on a monitor 34. 
[0009] A method of reverse playback using P and B 
pictures will be described. Figures 4(a) to 4(c) show a 
method of forward playback using P and B pictures. At 
the forward playback, when images are to be displayed 
in the order of B0, 11 , B2, P3, B4, 15, B6, and P7, pictures 
are inputted to the MPEG decoder 31 in the order of 11 , 
B0, P3, B2, 15, B4, P7, and B6. Then, the MPEG decoder 
31 stores reference pictures which are necessary to de- 
code B pictures, in the reference picture memory 32 ac- 
cording to the order shown in figure 4(c). Here, the pic- 
tures denoted by "I" are I pictures, which can be decod- 
ed without requiring other reference pictures to obtain 
video. The pictures denoted by "P" are P pictures, which 
require the forward prediction with referring to an imme- 
diately preceding I or P picture to be decoded. The pic- 
tures denoted by "B" are B pictures, which, otherwise 
specified, require the forward prediction with referring to 
an immediately preceding I or P picture and the back- 
ward prediction with referring to an immediately subse- 
quent I or P picture, to be decoded. 
[0010] The pictures decoded by the MPEG decoder 
31 are stored in the frame memory 33 in the order of B0, 
II , B2, P3, B4, 15 : B6, and P7, and displayed on the mon- 
itor 34 in the same order. At this time, a switch 36 is 
always in a state for passing the pictures. 
[0011] Figures 5(a) to 5(e) shows the method of re- 
verse playback using P and B pictures. The description 
is given of the method for reversely reproducing the pic- 
tures shown in figures 4 in the order of B4, P3, B2, and 
11. In order to decode B4 picture, reference pictures P3 
and 15 are required. However, to generate the reference 
picture P3, a further preceding 11 picture is required. 
That is, four pictures 11 , P3, 15, and B4 are required to 
decode the picture B4. Similarly, pictures 11 and P3 are 
required to decode picture P3, and pictures 11, P3 and 
B2 are required to decode picture B2. 11 picture does 
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not require other pictures to be decoded. 
[0012] When the picture B4 is to be decoded now, the 
pictures 11 , P3 and 15 should be decoded, in addition to 
the picture B4. The decoded pictures 11 , P3, and 15 are 
stored in the reference picture memory 32, but it is un- 
favorable that these pictures are stored in the frame 
memory 33. Thus, the switch 36 is controlled by a dis- 
play control unit 35 shown in figure 3 for outputting only 
the picture B4 to the frame memory 33 to be displayed. 
At this time, the display control unit 35 should generate 
commands 5B for instructing to perform decoding in the 
M PEG decoder 31 but not to display an obtained picture, 
and commands 5A for instructing to perform decoding 
in the MPEG decoder 31 and also performing image dis- 
play, as shown in figure 5(d), thereby controlling the 
switch 36 so as to control the storage of pictures into the 
frame memory 33. The same processing is performed 
also for other pictures. Here, in the case of playback oth- 
er than the reverse playback, which does not use B and 
P pictures, generated commands are all SB. 
[0013] As described above, when MPEG images are 
to be reversely reproduced, the function of performing 
control so as to decode pictures but not to display de- 
coded images is added in units of pictures, thereby to 
generate images reversely reproduced using P and B 
pictures. 

[0014] Figure 2 illustrates a prior art image transmit- 
ting apparatus. In this figure, reference numeral 21 de- 
notes a transmission apparatus. Numeral 22 denotes a 
storage device, which is a hard disk in this example, in 
which MPEG transport streams are recorded in an arbi- 
trary format. Numeral 23 denotes an IEEE1394 trans- 
mission/receiving means, and numeral 24 denotes a 
storage device control means. 

[0015] Numeral 25 denotes a reproduction apparatus, 
which comprises an IEEE transmission/receiving 
means 26, a command generation means 27, and an 
image reproduction means 28. In this figure, MPEG im- 
ages are recorded in the storage device 22 in the form 
of MPEG transport streams. The command generation 
means 27 in the reproduction apparatus 25 generates 
a reproduction command 2a for reproducing images 
from an MPEG transport stream which is stored in the 
storage device 22, and transmits the generated com- 
mand 2a to the IEEE1394 transmission/receiving 
means 26. The reproduction command 2a is compliant 
with a command of IEEE1394T.A. (Trade Association), 
which indicates a state of the playback, such as play- 
back, fast forward, reverse playback, stop of playback, 
and the like, but does not control reproduction of each 
picture. 

[0016] The IEEE1394 transmission/receiving means 
26 converts the reproduction command 2a into an asyn- 
chronous packet on the IEEE1394, and transmits the 
packet via the IEEE1394 network 2b to the IEEE1394 
transmission/receiving means 23. The IEEE1 394 trans- 
mission/receiving means 23 extracts the reproduction 
command 2a from the transmitted asynchronous pack- 
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et, and transmits the extracted command 2a to the stor- 
age device control means 24. The storage device con- 
trol means 24 reads an MPEG transport stream which 
is recorded in the storage device 22, corresponding to 
5 the reproduction command 2a, and transmits the read- 
out MPEG transport stream 6a to the IEEE1394 trans- 
mission/receiving means 23. 

[0017] The I EE E1 394 transmission/receiving means 
23 converts the MPEG transport stream 6a that is read 
10 out from the storage device 22 into an isochronous 
packet, and transmits the packet through the IEEE1 394 
network 2b. The transmitted isochronous packet is con- 
verted into an MPEG transport stream by the IEEE1 394 
transmission/receiving means 26, and transmitted to the 
15 image reproduction means 28. The components as 
shown in figure 3 other than the display control unit 35 
are included in the image reproduction means 28. Since 
a decoding control signal 3b outputted from the display 
control unit 35 in figure 3 is generated in synchronized 
with a picture which is read out of the storage device 22, 
this signal is stored in the storage device control means 
24. 

[0018] Figure 6 illustrates a structure of the IEEE1394 
transmission/receiving means 23 and 26. The reproduc- 
tion command 2a is converted into an asynchronous 
transfer packet by an asynchronous transfer means 61 , 
and transmitted/received via the IEEE1394 network 2b 
through an JEEE1394 link layer 63 and an IEEE1394 
physical layer 64. An MPEG transport stream 6a is con- 
verted into an IEEE1394 isochronous packet by an iso- 
chronous transfer means 62, and transmitted/received 
via the IEEE1 394 network 2b through the I EEE1 394 link 
layer 63 and the I EEE1 394 physical layer 64. The meth- 
od for converting the MPEG transport stream and the 
method for transmitting/receiving the packets by means 
of the IEEE1394 transmission/receiving means are de- 
termined in lEEE1394.The IEEE1394 link layer 63 and 
the IEEE 1394 physical layer 64 are standardized by 
IEEE1394. 

[0019] Figure 7 shows a structure of an MPEG trans- 
port stream. In figure 7, reference numeral 72 denotes 
a bit stream that is called an elementary stream in which 
information such as video or audio is described. As im- 
ages, MPEG video compressed bit streams are con- 
tained in many cases. This bit stream syntax is pursuant 
to a format that is defined by ISO/IEC 1 381 8-2. The el- 
ementary stream 72 sometimes contains 
Sequence_header, in which information about the meth- 
od for compressing images, identification of Standard 
Definition images and High Definition images, struc- 
tures of pictures, and output intervals between pictures 
are described. A stream which comprises the elemen- 
tary stream 72 and a PES header 71 that is defined by 
ISO/IEC 13818-1 is called a PES stream 70. 
[0020] The PES stream 70 is divided into an arbitrary 
size : then a header defined by ISO/IEC 13818-1 is add- 
ed to obtain a fixed packet of 1 88-byte length, and var- 
ious information is further added thereto to obtain mul- 
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tiple channels, resulting in an MPEG transport stream. 
[0021] Here i it is assumed that an MPEG image refers 
to an MPEG transport stream defined by ISO/I EC 
13818-1, which has elementary streams that are de- 
fined by ISO/IEC 13818-2 or ISO/IEC 11172-2 as pic- 
tures. 

[0022] When the images stored in the storage device 
are subjected to forward reproduction, stop of reproduc- 
tion, and reverse reproduction of only I pictures in the 
conventional structure as shown in figure 2, the repro- 
duction command 2a is transmitted or received in the 
asynchronous transfer mode and then the isochronous 
transfer is resumed, as shown in figures 2, 3, and 4. 
Even when the isochronous transfer is performed after 
it is confirmed that the transmission or receiving accord- 
ing to the asynchronous transfer is completed, images 
can be reproduced without problems. 
[0023] On the other hand, when the reverse playback 
using P and B pictures is performed, a decoding control 
signal should be generated for each picture. As this de- 
coding control signal depends on a structure of a GOP 
(Group Of Picture) , this signal is contained in the storage 
device control means 24 in figure 2. Accordingly, the de- 
coding control signal 3b that is generated by the display 
control unit 35 in the storage device control means 24 
must be transmitted to the image reproduction means 
28 in the reproduction apparatus 25 via the IEEE 1394 
network 2b. Since the decoding control signal 3b gen- 
erated by the display control unit 35 is synchronized with 
an image which is read out from the storage device 22 
and further this is a command signal, this signal should 
be transmitted in the asynchronous transfer mode 
through the IEEE1394 network 2b. 
[0024] To be more specific, an MPEG picture that is 
transferred in the isochronous transfer mode and the de- 
coding control signal 3b generated by the display control 
unit 35, which is transmitted in the asynchronous trans- 
fer mode, should be transmitted in synchronized with 
each other on the IEEE1394 network 2b. 
[0025] When an MPEG picture that is transferred ac- 
cording to the isochronous transfer is transmitted to the 
isochronous transfer means 62 after an asynchronous 
packet of the decoding control signal 3b generated by 
the display control unit 35 is inputted to the asynchro- 
nous transfer means 61 in the IEEE1 394 transmission/ 
receiving means 23, there are some cases where the 
IEEE1394 link layer 63 does not perform the asynchro- 
nous transfer of a previously inputted packet but per- 
forms the isochronous transfer of a later inputted pic- 
ture. This is because the transmission order of the asyn- 
chronous transfer and the isochronous transfer is not 
ensured in the IEEE 1394 standards. 
[0026] Even if the transfer is performed in the order of 
asynchronous transfer and isochronous transfer, there 
may be the possibility that the transmission order is in- 
verted after the receiving. After the completion of asyn- 
chronous transfer is checked, i.e., when the asynchro- 
nous transfer is performed while stopping the iso- 
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chronous transfer in the meantime and thereafter MPEG 
pictures are transmitted by the isochronous transfer 
means 62, the transfer rate may be adversely rate-de- 
termined to the asynchronous transfer rate, and the 
5 band for the isochronous transfer may not be ensured, 
because the transmission band of the asynchronous 
transfer is not ensured. The commands for reproduction 
or stop do not require to consider the transmission 
bands before and after the commands, but the control 
10 signal for each picture should ensure also the transmis- 
sion bands before and after the command. 
[0027] That is, in the conventional structure, the de- 
coding control signal 3b that is synchronized with a pic- 
ture cannot be transmitted or received to perform re- 
15 verse reproduction of MPEG images. 

[0028] The conventional reversely reproduced image 
generation apparatus has the aforementioned structure 
and, accordingly, when an apparatus for generating a 
reversely reproduced image via an IEEE1394 network 
20 is connected with an apparatus for decoding the re- 
versely reproduced image, an MPEG picture that is 
transferred in the isochronous transfer mode is not syn- 
chronized with a control signal that is transferred in the 
asynchronous transfer mode, because the transfer or- 
25 der of the asynchronous transfer and the isochronous 
transfer is not ensured, whereby the reversely repro- 
duced image cannot be decoded. 

SUMMARY OF THE INVENTION 

30 

[0029] The present invention has for its object to pro- 
vide a reproduced image transmitting apparatus which 
ensures a synchronization between an MPEG picture 
that is received on a reproduction apparatus side and a 
35 control signal for the MPEG picture, and enables the re- 
verse reproduction according to MPEG using P and B 
pictures. 

[0030] Other objects and advantages of the present 
invention will become apparent from the detailed de- 

40 scription and specific embodiments described are pro- 
vided only for illustration since various additions and 
modifications within the spirit and scope of the invention 
will be apparent to those of skill in the art from the de- 
tailed description. 

45 [0031] According to a 1st aspect of the present inven- 
tion, there is provided a reproduced image transmitting 
apparatus which transmits reproduced images through 
a bidirectional network that is constituted by an 
IE EE 1394 interface having two transfer modes, i.e., an 

50 isochronous transfer mode in which a band is ensured, 
and an asynchronous transfer mode in which images 
are transferred asynchronously, comprising: a datastor- 
age means for storing reproduced image data; and a 
data processing means for processing the reproduced 

55 image data which are read from the data storage means 
so as to transmit the reproduced image data and a re- 
production control parameter for controlling reproduc- 
tion of the reproduced image data, in the isochronous 
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transfer mode. Therefore, the synchronization between 
the control signal for each picture and the reproduced 
image data to be transferred is surely obtained, whereby 
reversely reproduced images can be obtained under the 
control of decoding in units of pictures. 
[0032] According to a 2nd aspect of the present in- 
vention, in the reproduction image transmitting appara- 
tus of the 1st aspect, the reproduced image data is an 
MPEG transport stream, and the reproduction control 
parameter is associated with an instruction as to decod- 
ing and display processes for the MPEG transport 
stream. Therefore, reversely reproduced images corre- 
sponding to an M PEG transport stream can be obtained 
under the control of decoding in units of pictures. 
[0033] According to a 3rd aspect of the present inven- 
tion, in the reproduction image transmitting apparatus 
of the 2nd aspect, the data processing means allocates 
the reproduction control parameter instructing to per- 
form decoding and to perform display, to perform decod- 
ing but not to perform display, not to perform decoding 
and to keep displaying a previous picture, or not to per- 
form decoding and not to display any picture, to an area 
from flags 3'b101 to 3'b111 of trick_mode_controf and 
following 5 bits in a DSM (Digital Storage Media) in 
PES_headerthatis defined by ISO/I EC 1381 8-1 .There- 
fore, the reproduction control parameter associated with 
control of decoding, reproduction, and display of images 
on the reproduction end can be transmitted by employ- 
ing a format defined by MPEG. 

[0034] According to a 4th aspect of the present inven- 
tion, in the reproduction image transmitting apparatus 
of the 3rd aspect, the data processing means allocates 
a reproduction control parameter instructing to perform 
decoding and to perform display, to trick_mode_controi 
= 3'b100 and rep_cntrl 5'bOOOOO in the DSM in 
PES_header defined by ISO/IEC 1381 8-1 . and a repro- 
duction control parameter instructing to perform decod- 
ing but not to perform display, to trickjnode_control = 
3'b100 and rep_cntrl 5'bOOOOO in the DSM of 
PESJieader. Therefore, the reproduction control pa- 
rameter associated with control of decoding, reproduc- 
tion, and display of pictures on the reproduction end can 
be transmitted by employing a format defined by MPEG. 
[0035] According to a 5th aspect of the present inven- 
tion, in the reproduction image transmitting apparatus 
of the 2nd aspect, the data processing means describes 
a control signal instructing to perform decoding and to 
perform display, to perform decoding but not to perform 
display, not to perform decoding and to keep displaying 
a previous picture, or not to perform decoding and not 
to display any picture, in PES_private_data or 
PES_extension_fieIdJength in PES_header defined by 
ISO/IEC 13818-1. Therefore, the reproduction control 
parameter associated with control of decoding, repro- 
duction, and display of pictures on the reproduction end 
can be transmitted by utilizing a format defined by 
MPEG. Further, the control of decoding, reproduction, 
and display of the respective pictures can be controlled 



even when one PES comprises plural pictures. 
[0036] According to a 6th aspect of the present inven- 
tion, the reproduction image transmitting apparatus of 
the 2nd aspect comprises: a code amount monitoring 

5 means for monitoring an amount of readout codes cor- 
responding to the reproduced image data which are 
read out from the data storage means and, when the 
code amount becomes smaller than a predetermined 
value, generating an underflow occurrence signal that 

10 indicates that an amount of data stored in a buffer of a 
decoder in a reproduction apparatus is smaller than an 
amount that is required for a decoding process; a dum- 
my data generation means for receiving the underflow 
occurrence signal generated by the code amount mon- 

15 itoring means, and generating dummy packets; and a 
selector means for embedding the dummy packets in 
the MPEG transport stream that has been processed by 
the data processing means. Therefore, the buffer under- 
flow on the reproduction end can be avoided, whereby 

20 problems that a decoding process is failed and images 
on the screen freeze or the like can be prevented. 
[0037] According to a 7th aspect of the present inven- 
tion, there is provided a reproduced image transmitting 
apparatus which transmits reproduced images through 

25 a bidirectional network that is constituted by an 
IEEE1394 interface having two transfer modes, i.e., an 
isochronous transfer mode in which a band is ensured, 
and an asynchronous transfer mode in which images 
are transferred asynchronously, in which a data storage 

30 means is included for storing the reproduced image data 
and a reproduction control parameter which is required 
to obtain the reproduced image data by the reverse re- 
production, and the reproduced image data and the re- 
production control parameter are transmitted in the iso- 

35 chronous transfer mode. Therefore, when the reverse 
reproduction command is transmitted from the receiving 
end, reversely reproduced images can be easily ob- 
tained on the receiving end only by transmitting prede- 
termined image data which are read out from the data 

40 storage means that contains reversely reproduced im- 
ages, to the receiving end through the IEEE1394 net- 
work. 

[0038] According to an 8th aspect of the present in- 
vention, in the reproduction image transmitting appara- 

^5 tus of the 2nd aspect, the data processing means de- 
scribes a reproduction control parameter instructing to 
perform decoding and to perform display, to perform de- 
coding but not to perform display, not to perform decod- 
ing and to keep displaying a previous picture, or not to 

50 perform decoding and not to display any picture, in 
Tempo raLReference in Picture_header defined by ISO/ 
I EC 13818-2. Therefore, in cases where one PES com- 
prises plural pictures, or the position of a picture and the 
header position of the PES are asynchronous with each 

55 other, the reverse reproduction can be performed nor- 
mally. 



5 



1263232A2 I > 



9 EP 1 263 232 A2 10 



spective pictures in the reproduced image transmit- 
ting apparatus according to the fourth embodiment. 
Figure 1 9 is a diagram for explaining changes in the 
amount of image data which are stored in a buffer. 
5 Figure 20 is a block diagram illustrating a structure 
of a reproduced image transmitting apparatus ac- 
cording to a fifth embodiment of the present inven- 
tion. 

Figures 21(a) to 21(c) are diagrams for explaining 
io an operation of a selector which constitutes the re- 
produced image transmitting apparatus according 
to the fifth embodiment. 

Figure 22 is a block diagram illustrating a structure 
of an MPEG transport stream processing means in 
*5 a reproduced image transmitting apparatus accord- 
ing to a sixth embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

20 

[Embodiment 1] 



BRIEF DESCRIPTION OF THE DRAWINGS 
[0039] 

Figure 1 is a block diagram illustrating a structure 
of a reproduced image transmitting apparatus ac- 
cording to a first embodiment of the present inven- 
tion. 

Figure 2 is a block diagram illustrating a structure 
of a prior art image reproduction apparatus. 
Figure 3 is a diagram illustrating a structure of a pri- 
or art MPEG decoder. 

Figures 4(a) to 4(c) are diagrams for explaining a 
method of forward play using P and B pictures. 
Figures 5(a) to 5(e) are diagrams for explaining a 
method of reverse play using P and B pictures. 
Figure 6 is a diagram illustrating a structure of an 
IEEE1394 transmission/receiving means. 
Figure 7 is a diagram for explaining a structure of 
an MPEG transport stream. 

Figure 8 is a block diagram illustrating a structure 
of an MPEG transport stream processing means. 
Figure 9 is a diagram for explaining a structure of a 
PES that is defined by MPEG. 
Figure 10 is a diagram for explaining descriptions 
of trick_mode_control and DSM_data which are re- 
written. 

Figure 11 is a diagram illustrating a structure of a 
reproduction control means which constitutes a re- 
production means. 

Figures 12(a) to 12(d) are diagrams for explaining 
timings of generating a picture control signal. 
Figure 13 is a diagram illustrating a structure of an 
MPEG image reproduction means which consti- 
tutes a receiver for receiving an MPEG transport 
stream that is transmitted from the reproduced im- 
age transmitting apparatus according to the first 
embodiment. 

Figure 14 is a block diagram illustrating a structure 
of a reproduced image transmitting apparatus ac- 
cording to a second embodiment of the present in- 
vention. 

Figure 15 is a diagram for explaining a method for 
generating a reversely reproduced image that is 
stored in a reversely reproduced image storage 
means in the reproduced image transmitting appa- 
ratus according to the second embodiment. 
Figure 1 6 is a diagram showing an example of com- 
mand setting by an MPEG transport stream 
processing means which constitutes a reproduced 
image transmitting apparatus according to a third 
embodiment of the present invention. 
Figure 17 is a diagram illustrating a structure of an 
MPEG transport stream processing means in a re- 
produced image transmitting apparatus according 
to a fourth embodiment of the present invention. 
Figure 18 is a diagram showing an example of a 
description of control signals corresponding to re- 



[0040] Figure 1 is a block diagram illustrating a struc- 
ture of an image transmitting apparatus as a reversely 

25 reproduced image generating apparatus according to a 
first embodiment of the present invention, in this figure, 
reference numeral 11 denotes a transmission appara- 
tus, which comprises a storage device 12 for storing da- 
ta, an IEEE1394 transmission/receiving means 13 as a 

30 data transmitting/receiving means, a reading means 14 
for reading predetermined data from the storage device 
12, and an MPEG transport stream processing means 
15 for processing an MPEG transport stream that is 
stored in the storage device 12. 

35 [0041 ] Numeral 1 6 denotes a reproduction apparatus, 
which comprises an IEEE1394 transmission/receiving 
means 17 as a data transmitting/receiving means, a 
command generation means 18 for generating a com- 
mand that is pursuant to IEEE1394 T.A. (Trade Associ- 

40 ation), an MPEG image reproduction means 19 for re- 
producing images from an inputted MPEG transport 
stream 1g to be displayed, and a reproduction control 
means 20 for controlling the MPEG image reproduction 
means 19. 

45 [0042] The transmission apparatus 1 1 and the repro- 
duction apparatus 16 are connected via an IEEE1394 
network 1 b. The storage device 1 2 is a device being ca- 
pable of random access, such as a hard disk, in which 
MPEG transport streams are recorded in arbitrary for- 

50 mats. These MPEG images are images defined by ISO/ 
IEC 13818-2 or ISO/IEC 11172-2. The MPEG transport 
stream is a stream including the MPEG images as an 
elementary stream, which is defined by ISO/IEC 
13818-1. 

55 [0043] Hereinafter, an operation will be described with 
reference to figure 1 . Like the prior art as shown in figure 
2, the command generation means 1 8 transmits a re- 
production command 1a that is pursuant to IEEE1394 
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T.A. (Trade Association) to the IEEE1 394 transmission/ 
receiving means 17. The IEEE1394 transmission/re- 
ceiving means 17 is connected with the IEEE 1394 net- 
work 1 b. and converts the reproduction command 1 a in- 
to an asynchronous packet of a format defined by 
IEEE1394 T.A (Trade Association), thereby to transmit 
the asynchronous packet to the IEEE1394 transmis- 
sion/receiving means 13 in the transmitting apparatus 
11. through the IEEE1394 network 1b. 
[0044] The structure of the I EE E1 394 transmission/ 
receiving means 1 3 and 1 7 is the same as shown in fig- 
ure 6 

[0045] The IEEE1394 transmission/receiving means 
13 e> tracts the reproduction command 1a from the re- 
ceives asynchronous packet, and transmits the extract- 
ed corrimnno *rt to mc -ending means 14. 
[0046] *fn 'e*arr.*; 14 selects pictures in ac- 

cord* *v t r or 'rx^jc! ion command 1a from the 

MPE£» ** M'«'-v- are stored in the storage 

device i. r*- ; tuv selected pictures to the 

MPEG im-w' r^occssing means 15 as an 

MPEG if<tns;^' ii'C/i^ *c Tor example, in the case of 
forward pi. yi>«to t*n ■ aiding means 14 selects pic- 
tures in thecoc o? BC ^2 B2, as in the order of 
pictures mputtoo to mc M^EG decoder 31 as shown in 
figure 4(a) Similarly » n mc case of reverse playback us- 
ing P and B pictures the reading means 14 selects four 
pictures in t ho order of M P3. 15, and B4 to display pic- 
ture B4, and outputs the selected pictures according to 
the order of pictures inputted to the MPEG decoder 31 , 
as shown in figure 5 

[0047] When the MPEG transport stream 1e transmit- 
ted to the MPEG transport stream processing means 15 
is outputted as it ts at the reverse playback using P and 
B pictures, an image that is different from a target image 
is adversely displayed. 

[0048] Thus, the MPEG transport stream processing 
means 15 adds a signal for controlling the reproduction 
control means 20. to the MPEG transport stream. An 
MPEG transport stream 1f to which the signal for con- 
trolling the reproduction control means 20 has been 
added is transmitted to the IEEE1394 transmission/re- 
ceiving means 13. 

[0049] Figure 8 illustrates a structure of the MPEG 
transport stream processing means 15, which compris- 
es a PES (Packetized Elementary Stream)_header de- 
tection means 81 , a DSM (Digital Storage Media) posi- 
tion detection means 82, a command judgement means 
83, and a DSM rewriting means B4. 
[0050] The readout MPEG transport stream 1e is in- 
putted to the PEG_header detection means 81, the 
DSM position detection means 82, and the DSM rewrit- 
ing means 84, respectively. The PES_header detection 
means 81 detects PES_header from the inputted MPEG 
transport stream 1e, and transmits a PES_header rec- 
ognition signal 8a to the DSM position detection means 
82. 

[0051] Figure 9 illustrates a structure of a PES. The 
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structure of a PES as shown in figure 9 is defined by 
ISO/IEC 1 381 8-1 . In this first embodiment, it is assumed 
that one PES comprises one MPEG picture. In figure 8, 
when the DSM position detection means 82 receives the 

5 PES_header recognition signal 8a, and when 
DSM_trickjmode_flag is on : the detection means 82 
transmits positions of trick_mode_control and 
DSM_data, as well as PES_CRCJIag of the next PES 
to the DSM rewriting means 84 as a DSM recognition 

10 signal 8b. On the other hand, when 
DSM_trick_mode_flag is off, the DSM position detection 
means 82 transmits PES_packet_length, 
DSM_trick_mode_flag : and PES_header_data_length, 
as well as PES_CRC_flag of the next PES to the DSM 

is rewriting means 84 as the DSM recognition signal 8b. 
The command judgement means 83 judges the inputted 
reproduction command 1a and, in the case of reverse 
reproduction, transmits a reverse reproduction signal 8c 
to the DSM rewriting means 84. 

20 [0052] When DSM_trick_mode_flag is on, the DSM 
rewriting means 84 rewrites trick_mode_control and 
DSM_data of the inputted MPEG transport stream 1e. 
The DSM rewriting means 84 further calculates CRC of 
the PES after the rewriting. When PES_CRC_flag is on 

25 jn the next PES, the DSM rewriting means 84 rewrites 
PES_CRC and transmits the MPEG transport stream 1f 
to the IEEE1394 transmission/receiving means 13. 
[0053] When the DSM_trick_mode_flag is off, the 
DSM rewriting means 84 rewrites PES_packet_length 

30 as zero or adds 1 to PES_packet_length, sets 
DSM_trick_mode_flag : adds 1 to 

PES_header_dataJength, and inserts the obtained da- 
ta in the positions of trick_mode_control and DSM_data. 
The DSM rewriting means 84 further calculates CRC of 

35 the PES afterthe rewriting. When PES_CRC_flag is on 
in the next PES, the DSM rewriting means 84 rewrites 
PES_CRC, and transmits an obtained MPEG transport 
stream 1f to the IEEE1394 transmission/receiving 
means 13. 

40 [0054] Practical examples of trick_mode_control and 
DSM_data, which are rewritten by the DSM rewriting 
means 84 are shown in figure 1 0. In figure 1 0, command 
A provides a description that instructs to decode an 
MPEG image and display a decoded picture, and this is 

45 the same as the command 5A in figure 5. Command B 
provides a description that instructs to decode an MPEG 
image and not to display the decoded picture but keep 
displaying a decoded picture that was previously dis- 
played as it is, and this is the same as the command 5B 

50 in figure 5. Command C provides a description that in- 
structs not to decode an inputted MPEG image and clear 
a previously displayed decoded picture. Command D 
provides a description that instructs not to decode an 
inputted MPEG image but to keep displaying a previ- 

55 ously displayed decoded picture as it is. 

[0055] The MPEG transport stream processing 
means 15 adds the commands that are generated by 
the display control unit 35 as shown in figure 5(d). to 
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PES_header. The MPEG transport stream processing 
means 1 5 performs processing so that the command 5B 
in figure 5(d) corresponds to the command B in figure 
10 and the command 5A in figure 5(d) corresponds to 
the command A in figure 1 0. In figure 1 , the MPEG trans- 
port stream 1f that has been transmitted to the 
IEEE1394 transmission/receiving means 13 is convert- 
ed into an isochronous packet by the IEEE1394 trans- 
mission/receiving means 13, and transmitted through 
the IEEE1394 network 1b. 

[0056] The isochronous packet is transmitted to the 
reproduction apparatus 16 through the IEEE 1394 net- 
work 1b, converted into an MPEG transport stream 1g 
in the IEEE1394 transmission/receiving means 17, and 
transmitted to the MPEG image reproduction means 19 
and the reproduction control means 20. The reproduc- 
tion control means 20 extracts the command processed 
by the MPEG transport stream processing means 1 5 as 
shown in figure 1 0, from the MPEG transport stream 1 g, 
and transmits the extracted command to the MPEG im- 
age reproduction means 19 as a picture control signal 
1h. 

[0057] Figure 11 shows a structure of the reproduction 
control means 20. In figure 11 , the inputted MPEG trans- 
port stream 1g is transmitted to a command extraction 
means 111 and a Picture_header detection means 112. 
The command extraction means 111 extracts the com- 
mand processed in the MPEG transport stream 
processing means 15 as shown in figure 10, from the 
M PEG transport stream 1 g, and transmits a picture con- 
trol signal 11 a to a synchronization output means 113. 
[0058] The Picture_header detection means 112 ex- 
tracts Picturejieader from the MPEG transport stream 
1g, and outputs a picture synchronizing signal 11b indi- 
cating that Picutre_header has been detected, to the 
synchronization output means 113. The synchronization 
output means 1 1 3 outputs the picture control signal 1 1 a 
in synchronized with the picture synchronizing signal 
11b, as the picture control signal 1h Figures 12(a) to 12 
(d) show the relationship between the MPEG transport 
stream 1 g that is inputted to the reproduction control 
means 20, and the outputted picture control signal 1h. 
In figures 12, numeral 121 denotes an MPEG transport 
stream packet including PES_header in the inputted 
MPEG transport stream 1g. Numeral 122 denotes an 
MPEG transport stream packet including the picture 
control signal 11a in the inputted MPEG transport 
stream 1g. Numeral 123 denotes a packet including a 
Picture. header in the inputted MPEG transport stream 
1g. The packets 121 , 122 and 123 may be the same 
packet, but PES_header, the picture control signal, and 
Picture_header are inputted in this order. 
[0059] The Picture_header detection means 112 de- 
tects a Picture_header from the packet 1 23, and gener- 
ates the picture synchronizing signal 11b. The picture 
control signal 11a that is extracted from the packet 122 
is transmitted in synchronized with the picture synchro- 
nizing signal 11b generated from the packet 123, as the 
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picture control signal 1h. 

[0060] The MPEG image reproduction means 19 re- 
produces pictures from the inputted MPEG transport 
stream 1g to be displayed. The structure of the MPEG 

5 image reproduction means 1 9 is shown in figure 1 3. The 
elements other than a command receiving unit 131 and 
a decoding control signal 13b are the same as those in 
the prior art as shown in figure 3. 
[0061] The command receiving unit 131 receives the 

10 picture control signal 1 h. When the command A in figure 
10 is inputted to the command receiving unit 131, the 
unit 131 transmits a display control signal 13a to the 
switch 36 for controlling to input an decoded picture to 
the frame memory 33, and a decoding control signal 1 3b 

is to the MPEG decoder 31 for controlling to execute de- 
coding. When the command B in figure 10 is inputted, 
the command receiving unit 131 transmits the display 
control signal 1 3a to the switch 36 for controlling not to 
input an decoded picture into the frame memory 33 but 

20 to keep the picture, and the decoding control signal 1 3b 
to the MPEG decoder 31 for controlling to execute de- 
coding. When the command C in figure 10 is inputted, 
the unit 131 transmits the display control signal 13a to 
the switch 36 for controlling to input a decoded picture 

25 into the frame memory 33 or to clear an image in the 
frame memory 33, and the decoding control signal 13b 
to the MPEG decoder 31 for controlling not to execute 
decoding. When the command D as shown in figure 10 
is inputted, the unit 1 31 transmits the display control sig- 

30 nal 1 3a to the switch 36 for control ling to keep the picture 
in the frame memory 33, and the decoding control signal 
1 3b to the MPEG decoder 31 for controlling not to exe- 
cute decoding. 

[0062] According to the first embodiment, when 

35 MPEG transport stream data which are transmitted from 
the transmitting apparatus 11 to the reproduction appa- 
ratus 16 and control signals for respective pictures are 
transmitted, the control signals for the respective pic- 
tures are embedded in unused parts in the DSM that is 

40 defined by MPEG, or by using the DSM efficiently, to be 
transmitted in the isochronous transfer mode. There- 
fore, in the image transmitting apparatus in the bidirec- 
tional network system employing the IEEE 1394 inter- 
face, which does not ensure the transmission order of 

45 the isochronous transfer and the asynchronous transfer, 
the control for each picture and the synchronization of 
an MPEG transport stream to be transferred can be 
completely ensured, whereby the reverse reproduction 
of pictures can be performed under the control of de- 

50 coding for each picture. 

[Embodiment 2] 

[0063] Figure 14 shows an image transmitting appa- 
55 ratus according to a second embodiment of the present 
invention. The same reference numerals as those in the 
prior art structure as shown in figure 2 denote the same 
or corresponding components. A transmission appara- 
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tus 1 40 is provided with a reversely reproduced image 
storage device 141 in place of the storage device 22, 
and a reversely reproduced image storage device read- 
ing means 142 in place of the storage device control 
means 24. The reproduction apparatus 1 6 includes the 
reproduction control means 20, and is connected to the 
transmitting apparatus 140 via the IEEE1394 network 
1b. Here, the reversely reproduced image storage de- 
vice 141 is a storage device, such as a hard disk, in 
which reversely reproduced images of such formats that 
are generated according to the first embodiment are 
stored. A method for storing the reversely reproduced 
images in the reversely reproduced image storage de- 
vice 141 will be shown in figure 15. 
[0064] In figure 15, a transmission apparatus 150 is 
the same as the transmission apparatus described in 
the first embodiment. An IEEE1394 transmission/re- 
ceiving means 1 51 is the same as the IEEE1 394 trans- 
mitting/receiving means 1 7 in the first embodiment. Nu- 
meral 152 denotes a storage medium, such as a hard 
disk. A command generation means 153 is the same as 
the command generation means 1 8 in the first embodi- 
ment. 

[0065] Hereinafter, the operation of the transmission 
apparatus will be described. The command generation 
means 1 53 generates a reverse reproduction command 
15a, and transmits the reverse reproduction command 
15a through the IEEE1394 transmission/receiving 
means 151 to the IEEE1394 network 1b, to transmit the 
reverse reproduction command 15a to the transmitting 
apparatus 150. 

[0066] At this time, the reverse reproduction com- 
mand which instructs to reversely reproduce all of I, P, 
and B pictures is transmitted by using a 1x-speed re- 
verse reproduction command or the like. The reversely 
reproduced images which are generated by the trans- 
mission apparatus 150 are stored in the storage medium 
152 through the IEEE1394 network 1b and the 
I EEE1 394 transmission/receiving means 151. The stor- 
age medium 152 in which reversely reproduced images 
corresponding to all of I, P, and B pictures are stored is 
the reversely reproduced image storage device 141 in 
figure 14. 

[0067] The reversely reproduced image storage de- 
vice reading means 142 reads reversely reproduced Im- 
ages which are stored in the reversely reproduced im- 
age storage device 141 as required, when the reproduc- 
tion command 1a requests reverse playback. In the 
case of forward playback, the reading means 1 42 prop- 
erly reproduces only images in which the command A 
is described. 

[0068] In the case of reverse playback, since the re- 
adout reversely reproduced image has already been 
subjected to the DSM processing, it is not required to 
reprocess the image in the transmission apparatus 1 40. 
Accordingly, when the transmission apparatus includes 
the reversely reproduced image storage device 141 in 
which reversely reproduced images are stored, and the 



reversely reproduced image storage device reading 
means 142 for reading these images, reversely repro- 
duced images can be properly obtained even by em- 
ploying the prior art structure. 

5 [0069] According to the second embodiment, re- 
versely reproduced images of all I, P and B pictures are 
stored in the reversely reproduced image storage de- 
vice 141 and, when a reverse reproduction command is 
transmitted from the receiving end, the reversely repro- 

10 duced image storage device reading means 1 42 reads 
the reversely reproduced image and transmits the im- 
age data to the receiving end via the IE EE1 394 network 
1b. Therefore, the reversely reproduced images can be 
easily obtained on the receiving end. 

15 

[Embodiment 3] 

[0070] A reproduced image transmitting apparatus 
according to a third embodiment will be described. Fig- 

20 ure 1 6 shows another examples of the commands which 
are processed by the MPEG transport stream process- 
ing means 1 5 in the image transmitting apparatus of the 
first embodiment, which commands have formats differ- 
ent from those shown in figure 10 according to the first 

25 embodiment. In figure 1 6, data of trick_mode_control is 
different from that shown in figure 10, and indicates 
3'b1 00. This represents slow_reverse according to ISO/ 
IEC 13818-1 , and means slow reverse playback. When 
trick_mode_control indicates 3'b100, parameter 

30 rep_cntrl indicating the number of displays correspond- 
ing to the picture is set on lower-order 5 bits. This pa- 
rameter is set at a value other than zero in the case of 
the command A, and set at zero in the case of the com- 
mand B. The commands C and D are not employed. 

35 [0071] In the first embodiment, the commands are al- 
located to an area which is not defined by ISO/I EC 
13818-1, while in this third embodiment only the com- 
mands A and B are set in an area which is defined by 
ISO/IEC 13818-1. Accordingly, the reproduction appa- 

40 ratus 1 6 can dispense with a circuit for controlling the 
area that is not defined by ISO/IEC 13818-1, thereby 
reducing the scale of the apparatus. That is, the scale 
of the apparatus can be reduced by an area correspond- 
ing to the MPEG image reproduction means 1 9 and the 

45 reproduction control means 20 in figure 1 . 

[Embodiment 4] 

[0072] A reproduced image transmitting apparatus 
50 according to a fourth embodiment of the present inven- 
tion will be described. In the aforementioned first to third 
embodiments, it is assumed that one PES comprises 
one picture. However, there are some cases where one 
PEG comprises plural pictures. In these cases, only by 
55 extending codes of DSM as shown in the first to third 
embodiments, one PES can contain only a description 
associated with one picture, because the DSM includes 
only an 8-bit description area. Therefore, the plural pic- 
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tures included in one PEG cannot be controlled. 
[0073] In this fourth embodiment, control signals for 
respective pictures are written in an area corresponding 
to PEG private_data in the PEG_header, thereby han- 
dling the case where one PES comprises plural pictures. 
[0074] Figure 17 is a diagram illustrating a structure 
of ar MPEG transport stream processing means ac- 
cording to tne fourth embodiment. In figure 17, numeral 
171 denotes a PES_private_data position detection 
means Numeral 172 denotes a PES_private_data re- 
writing means. The PES_header detection means 81 
and the command judgement means 83 are the same 
as those shown in figure 8. PES_private_data is includ- 
ed »n PES extension in figure 9, and defined in ISO/I EC 
1381 P i toqetnc with PES extensionjield (which will 
be dosr tf>oa U!c ; 

[0075) *r H f*t :r v«*hic data position detection 
mennv. moulted PES_header recogni- 

tion s»q' : •*« f ^ Jout MPEG transport stream 

image 1* W>f PES_private_data and 
PES. citcn,<^ uxytc ri'u . eluded in the MPEG trans- 
port strcrt^ r*v5>- ic octection means 171 detects 
the position c J f t r e« , l c~sion_field and the length of 
written at:.; .no transmits the same as a 
PES_privaK o.tu recognition signal 17a to the 
PES_prrvatc ovr^ rcwr imq means 172. 
[0076] Whcr. PLS pnv*te_data is included and 
PES_exten*iori t.oid not included in the MPEG trans- 
port stream imago 1c the PES_private_data position 
detection means 17 detects the position in which 
PES_extension lield is written, and outputs the detect- 
ed position as the PES private_data recognition signal 
1 7a to the PES„ private_data rewriting means 1 72. 
[0077] When PES_private_data is not included in the 
MPEG transport stream image 1e, the 
PES_private_data position detection means 171 de- 
tects a position in which PES_private_data is written, 
and transmits the detected position as the 
PES_private_data recognition signal 17a to the 
PES_private_data rewriting means 172. 
[0078] When the PES_private_data recognition sig- 
nal 17a indicates that PES_private_data and 
PES_extension_field are included in the MPEG trans- 
port stream image 1e. the PES_private_data rewriting 
means 172 adds a length that is required to describe a 
control signal for each picture, to the length correspond- 
ing to PES_exLension_field_length of the readout 
MPEG transport stream image 1 e, thereby to add a con- 
trol signal for each picture to PES_extension_field. Fur- 
ther, PES_packet_length and 
PES_header_data_length are rewritten in the same 
manner as in figure 8. An example where the control 
signals for the respective pictures are described is 
shown in figure 1 8. 

[0079] In figure 1 8, it is assumed that the number of 
pictures included in a PES is "n". A 1-byte descriptor 
indicating that a picture control signal at the reverse 
playback is described is located at the head, and 1 -byte 



control signals corresponding to the respective pictures 
which are included in this PES are described behind the 
descriptor. The control signal for each picture may be a 
control signal that is shown in figure 10 or 16. Accord- 

5 ingly, the control signals for all pictures which are includ- 
ed in the PES can be described by the length of (n+1) 
bytes. Further, when the control signals are described 
in this manner, the reproduction control means 20 in fig- 
ure 1 is configured to recognize these control signals. 

w [0080] When the PES_private_data recognition sig- 
nal 17a indicates that PES_private_data is included and 
PES_extension_field is not included, the 
PES_private_data rewriting means 172 sets 
PES_extensionJlag of the readout MPEG transport 

15 stream image 1 e at 1 , adds a length that is required to 
describe the control signal for each picture, to the length 
corresponding to PES_extension_fieldJength, and 
adds the control signal for each picture in 
PES_extensionJield. In addition, PES_packet_length 

20 and PES_header_length are also rewritten in the same 
manner as in figure 8. 

[0081] From the aforementioned structure, even 
when one PES comprises plural pictures, the control 
signals for the respective pictures can be described. 
25 This is effective even when one PES comprises one pic- 
ture. 

[0082] According to the fourth embodiment, the con- 
trol signals for respective pictures are written in the 
PES_private_data area of PESJieader. Therefore, 
30 even when one PES comprises plural (n) pictures, the 
control signals for all of the pictures can be described in 
the length corresponding to (n+1) bytes, thereby han- 
dling the case where one PES comprises plural pictures. 

35 [Embodiment 5] 

[0083] A reproduced image transmitting apparatus 
according to a fifth embodiment of the present invention 
will be described. The MPEG decoder 31 in figure 13 

40 has a buffer for storing an inputted MPEG transport 
stream 1g, or a video elementary stream which is ex- 
tracted from the MPEG transport stream 1g. Figure 19 
shows changes of image data which are stored in the 
buffer according to time series. 

45 [0084] In figure 19, the ordinate represents the 
amount of data stored in the buffer, and the abscissa 
represents the time. A line 191 shows the changes in 
the amount of stored data. When the MPEG transport 
stream 1g is inputted, the amount of data stored in the 

so buffer is increased as shown by a portion 1 92. As imag- 
es are decoded, the amount of data stored in the buffer 
is decreased as shown by a portion 1 93. However, in 
the decoding or display of images, there are a possibility 
that the decoding or display desired by the MPEG de- 

55 coder 31 is not performed or the reproduction apparatus 
16 erroneously operates, unless the buffer contains a 
predetermined amount of data, except at the initial state. 
A line 194 shows a lower limit of the amount of stored 
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data in the buffer, which is required for the reproduction 
apparatus 16 including the MPEG decoder 31 to per- 
form normal reproduction. 

[0085] In figure 19, numeral 195 denotes a state in 
which data is below the lower limit shown by the line 
194. Numeral 196 denotes a state in which the buffer is 
empty. Assuming that these states are referred to as un- 
derflow states, there are some cases where the repro- 
duction apparatus 16 does not operate normally in the 
underflow states. The underflow does not occur in nor- 
mal MPEG images, but when pictures which are not 
continuous are connected with each other by trick play 
like the reverse playback, the underflow often occurs at 
a joint part of the connected pictures. 
[0086] Figure 20 shows a structure of a transmission 
apparatus 200 which is obtained by adding a code 
amount monitoring means 201 , a dummy data genera- 
tion means 202, and a selector 203 to the transmission 
apparatus 1 1 according to the first embodiment, to avoid 
the aforementioned problem. 

[0087] In figure 20, numeral 200 denotes a transmis- 
sion apparatus. The code amount monitoring means 
201 monitors a code amount of the readout MPEG 
transport stream image 1e, and checks whether the 
buffe r may turn into the underflow state or not. When 
the code amount monitoring means 201 decides that the 
underflow may occur with respect to the readout MPEG 
iransoort stream 1e, the monitoring means 201 trans- 
m ts an underflow occurrence signal 20a to the dummy 
data generation means 202. 

[0088] The dummy data generation means 202 gen- 
erates a dummy packet 20b and transmits the dummy 
packet 20b to the selector 203 so as to prevent the un- 
derflow state. The dummy data generation means 202 
generates an MPEG transport stream packet corre- 
sponding to a NULL or stuffing packet as the dummy 
packet 20b thereby to prevent the underflow of the buff- 
er for the MPEG transport stream, while generating an 
M^EG transport stream having stuffing data of an 
M 3 EG video elementary stream as payload, thereby to 
prevent the underflow between pictures of the MPEG 
video elementary stream. 

[0089] The selector 203 inserts the dummy packet 
20b into the processed MPEG transport stream image 
1 f and transmits an M PEG transport stream 20c to the 
IEEE1394 transmission/receiving means 13. 
[0090] Here : the operation of the selector 203 will be 
described with reference to figure 21 . The underflow can 
be solved by embedding the dummy packets 20b in in- 
tervals between packets corresponding to the readout 
MPEG transport stream image 1e. The selector 203 in- 
serts the dummy packets 20b into the readout MPEG 
transport stream image 1e so as to shorten the longer 
intervals between the packets corresponding to the 
MPEG transport stream image 1 e, and transmits the ob- 
tained MPEG transport stream 20c. 
[0091] According to the fifth embodiment, the code 
amount monitoring means 201 monitors the code 



amount of the MPEG transport stream image 1 e that is 
read out from the storage device 1 2 in the transmission 
apparatus 200. When the underflow state is detected, 
the dummy data generation means 202 generates the 

5 dummy packet 20b so as to prevent the underflow state, 
and embeds the dummy packet 20b in the MPEG trans- 
port stream. Therefore, the underflow in the reproduc- 
tion apparatus 16 can be avoided, whereby problems 
that the decoding process is failed and images on the 

10 screen freeze or the like can be prevented. 

[Embodiment 6] 

[0092] A reproduced image transmitting apparatus 

*5 according to a sixth embodiment of the present inven- 
tion will be described. Figure 22 is a block diagram illus- 
trating an MPEG transport stream processing means 
1 5b in the reproduced image transmitting apparatus ac- 
cording to the sixth embodiment. The reproduced image 

20 transmitting apparatus of the sixth embodiment is the 
same as that in the first embodiment, except for the 
MPEG transport stream processing means 15b. In this 
sixth embodiment, a Picturejieader detection means 
221 , a Temporal_Reference detection means 222, and 

25 a Temporal_Reference rewriting means 223 are provid- 
ed in the MPEG transport stream processing means as 
shown in figure 1 7, in place of the PES_header detec- 
tion means 81 , the PES_private_data position detection 
means 1 71 , and the PES_private_data rewriting means 

30 172, respectively. In this sixth embodiment, control sig- 
nals for respective pictures are written in an area corre- 
sponding to TemporaLReference included in the picture 
header that is defined by ISO/I EC 13818-2. 
[0093] Next, the operation will be described. 

35 [0094] When the readout MPEG transport stream 1 e 
is inputted; the Picture_header detection means 221 de- 
tects a picture header included in the MPEG transport 
stream 1 e, and transmits a picture header detection sig- 
nal 22a to the TemporaLReference detection means 

40 222. When the TemporaLReference detection means 
222 detects the picture header detection signal 22a, the 
detection means 222 detects the position of 
TemporaLReference included in the picture header, 
and transmits a detection signal 22b indicating the po- 

45 sition of TemporaLReference to the 
TemporaLReference rewriting means 223. The 
TemporaLReference rewriting means 223 writes a con- 
trol signal for each picture at the position of 
TemporaLReference that is indicated by the detection 

so signal 22b indicating the position of 
TemporaLReference. 

[0095] For example, when decoding is executed and 
decoded images are to be displayed, the order in which 
the decoded images are displayed is written in 
55 TemporaLReference. When decoding is executed and 
decoded images are not to be displayed, a picture dis- 
play order that is rarely employed for normal images, 
such as 10^1111111111 (the 1024th), is given to 
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Temporal_Reference. Accordingly, the control for exe- 
cuting the decoding but not displaying decoded images 
can be realized. Further, since Tempo raLReference is 
included in all pictures, also in cases where the position 
of the PES header is not synchronized with the position 
of the picture, a decoding signal can be transmitted in 
units of pictures. 

[0096] According to the sixth embodiment, the control 
signals for controlling pictures are written in 
TemporaLReference included in Picture_header, and 
transmitted together with image data to be displayed, in 
the isochronous transfer mode on the IEEE1394 net- 
work. Therefore, also in cases where one PES compris- 
es plural pictures, or the positions of the picture and the 
PES header are not synchronized with each other, the 
proper reverse reproduction can be performed. 



Claims 

1 . A reproduced image transmitting apparatus which 
transmits reproduced images through a bidirection- 
al network that is constituted by an IEEE 1394 inter- 
face having two transfer modes, i.e., an iso- 
chronous transfer mode in which a band is ensured, 
and an asynchronous transfer mode in which imag- 
es are transferred asynchronously, comprising: 

a data storage means for storing reproduced 
image data; and 

a data processing means for processing the re- 
produced image data which are read from the 
data storage means so as to transmit the repro- 
duced image data and a reproduction control 
parameter for controlling reproduction of the re- 
produced image data, in the isochronous trans- 
fer mode. 

2. The reproduced image transmitting apparatus of 
Claim 1 wherein 

the reproduced image data is an MPEG trans- 
port stream, and 

the reproduction control parameter is associ- 
ated with an instruction as to decoding and display 
processes for the MPEG transport stream. 

3. The reproduced image transmitting apparatus of 
Claim 2 wherein 

the data processing means allocates the re- 
production control parameter instructing to perform 
decoding and to perform display, to perform decod- 
ing but not to perform display, not to perform decod- 
ing and to keep displaying a previous picture, or not 
to perform decoding and not to display any picture, 
to an area from flags 3'b101 to 3'b111 of 
trick_mode_control and following 5 bits in a DSM 
(Digital Storage Media) in PESJieader that is de- 
fined by ISO/IEC 13818-1. 



4. The reproduced image transmitting apparatus of 
Claim 3 wherein 

the data processing means allocates a repro- 
duction control parameter instructing to perform de- 

5 coding and to perform display, to 
trick_mode_control = 3'b100 and rep_cntrl 
5'b00000 in the DSM in PESJieader defined by 
ISO/IEC 13818-1, and a reproduction control pa- 
rameter instructing to perform decoding but not to 

10 perform display, to trick_mode_control = 3'b1 00 and 
rep_cntrl 5'bOOOOO in the DSM of PES_header. 

5. The reproduced image transmitting apparatus of 
Claim 2 wherein 

15 the data processing means describes a con- 

trol signal instructing to perform decoding and to 
perform display, to perform decoding but not to per- 
form display, not to perform decoding and to keep 
displaying a previous picture, or not to perform de- 

20 coding and not to display any picture, in 
PES_private_data or PES_extensionJfield_length 
in PES_header defined by ISO/IEC 13818-1. 

6. The reproduced image transmission apparatus of 
25 Claim 2 comprising: 

a code amount monitoring means for monitor- 
ing an amount of readout codes corresponding 
to the reproduced image data which are read 

30 out from the data storage means and, when the 

code amount becomes smaller than a prede- 
termined value, generating an underflow occur- 
rence signal that indicates that an amount of 
data stored in a buffer of a decoder in a repro- 

35 duction apparatus is smaller than an amount 

that is required for a decoding process; 
a dummy data generation means for receiving 
the underflow occurrence signal generated by 
the code amount monitoring means, and gen- 

40 erating dummy packets; and 

a selector means for embedding the dummy 
packets in the MPEG transport stream that has 
been processed by the data processing means. 

45 7. a reproduced image transmitting apparatus which 
transmits reproduced images through a bidirection- 
al network that is constituted by an IEEE1 394 inter- 
face having two transfer modes, i.e., an iso- 
chronous transfer mode in which a band is ensured, 

50 and an asynchronous transfer mode in which imag- 
es are transferred asynchronously, wherein 

a data storage means is included for storing 
the reproduced image data and a reproduction con- 
trol parameter which is required to obtain the repro- 

55 duced image data by reverse reproduction, and 

the reproduced image data and the reproduc- 
tion control parameter are transmitted in the iso- 
chronous transfer mode. 
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8. The reproduced image transmitting apparatus of 
Claim 2 wherein 

the data processing means describes a repro- 
duction control parameter instructing to perform de- 
coding and to perform display, to perform decoding 5 
but not to perform display, not to perform decoding 
and to keep displaying a previous image, or not to 
perform decoding and not to display any image, in 
Tempo ral_ Reference in Ptcture_header defined by 
ISO/I EC 13818-2. 10 
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